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Abstract. Motivated by synchronization problems in noisy environments, 
we study the Edwards- Wilkinson process on weighted uncorrelated scale-free 
networks. We consider a specific form of the weights, where the strength (and 
the associated cost) of a link is proportional to (kikj)@ with ki and kj being 
the degrees of the nodes connected by the link. Subject to the constraint that 
the total network cost is fixed, we find that in the mean-field approximation on 
uncorrelated scale-free graphs, synchronization is optimal at /3*=— 1. Numerical 
results, based on exact numerical diagonalization of the corresponding network 
Laplacian, confirm the mean-field results, with small corrections to the optimal 
value of j3*. Employing our recent connections between the Edwards- Wilkinson 
process and resistor networks, and some well-known connections between random 
walks and resistor networks, we also pursue a naturally related problem of 
optimizing performance in queue-limited communication networks utilizing local 
weighted routing schemes. 
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1. Introduction 

Synchronization in natural and artificial complex interconnected systems ^ El E] 
has been the focus of interdisciplinary research with applications ranging from 
neurobiology ecology and population dynamics |S| to scalable computer 
networks 1101 1111 1121 113| . In the recent flood of research on complex networks, 
[TH HSl HI)! im IT81 IT§| , the focus has shifted from structure to various dynamical and 
stochastic processes on networks, synchronization is being one of them. The common 
question addressed by most studies within their specific context is how the collective 
response of locally-coupled entities is influenced by the underlying network topology. 

A large number of studies investigated the Kuramoto model of coupled oscillators 
0H2H], naturally generalized to complex networks |211 1221 05] , The common feature 
of the findings is the spontaneous emergence of order (synchronous phase) on complex 
networks, qualitatively similar to that observed on fully connected networks, in 
contrast to regular networks in low dimensions. Another large group of studies 
addressed synchronization in coupled nonlinear dynamical systems (e.g., chaotic 
oscillators) on small-world (SW) E3] and scale-free (SF) 123 EH E3 E3 EH1 
networks. The analysis of synchronization in the latter models can be carried 
out by linearization about the synchronous state and using the framework of the 
master stability function |ril| . In turn, the technical challenge of the problem is 
reduced to the diagonalization of the Laplacian on the respective network, and 
calculating or estimating the eigenratio EU (the ratio of the largest and the 
smallest non-zero eigenvalue of the network Laplacian), a characteristic measure of 
synchronizability (smaller eigenratios imply better synchronizability) . Along these 
lines, most recent studies EB1 EH EH ED] considered not only complex, possibly 
heterogeneous, interaction topologies between the nodes, but also heterogeneities in 
the strength of the couplings (also referred to as weighted complex networks). 

In a more general setting of synchronization problems, the collective 
behavior/response of the system is obviously strongly influenced by the nonlincarities, 
the coupling/interaction topology, the weights/strength of the (possibly directed) 
links, and the presence and the type of noise OEH]- Here, we study synchronization 
in weighted complex networks with linear coupling in the presence of delta- 
correlated white noise. Although it may appear somewhat simplistic (and, indeed 
prototypical), such problems are motivated by the dynamics and fluctuations in 
task completion landscapes in causally-constrained queuing networks [221, with 
applications in manufacturing supply chains, e-commerce-based services facilitated by 
interconnected servers \6'6\ . and certain distributed-computing schemes on computer 
networks EB EU d El This simplified problem is the Edwards- Wilkinson (EW) 
process [2U on the respective network [551 1551 . 

Here, we consider a specific and symmetric form of the weights on uncorrelated 
SF networks, being proportional to (kikj)^ where hi and kj are the degrees of the 
nodes connected by the link EH|- The above general form has been suggested by 
empirical studies of metabolic |4(Jj and airline transportation networks 141) . Here, we 
study the effect of such weighting scheme in our synchronization problem. Associating 
the weight/strength of each link with its cost, we ask what is the optimal allocation of 
the weights (in terms of (3) in strongly heterogeneous networks, with a fixed total cost, 
in order to maximize synchronization in a noisy environment. For the EW process 
on any network, the natural observable is the width or spread of the synchronization 
landscape (23 EH EH EH EH]' Then the task becomes minimizing the width as a 
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function of f3 subject to a (cost) constraint. 

Despite differences in the assumptions concerning noise and constrained cost, 
our study's results are very similar to findings by Zhou et al. |28| . who investigated 
synchronization of coupled nonlinear oscillators on the same type of network. The 
optimal value of (3 is close to —1 (and is exactly —1 in the mean-field approximation 
on uncorrelated random SF networks.) The two problems are intimately connected 
through the eigenvalue spectrum of the same network Laplacian. 

Transport and flow on complex networks have also become the subject of 
intensive research with applications to biological, transportation, communication, 
and infrastructure networks [301 EH E3 ESI E31 EH EU EZ1 EU EI3 EDI EH E3 E3 
EU ESI ESI E3 EH EH1 E01 EU E2 ESI While our main motivation is the above 
described synchronization phenomena in noisy environments, we also explore some 
natural connections with idealized transport and flow problems on complex networks, 
in particular, connections with local routing schemes [551 ESI EH- Connections between 
random walks and resistor networks have been discussed in detail in several works 
[Ml IHSl ES|- Further, we have recently pointed out some useful connections 
between the EW process and resistor networks (both systems' behavior is governed 
by the same network Laplacian). Thus, our results for the synchronization problem 
have some straightforward implications on the related resistor network and random 
walk problems, pursued in the second part of this work. 

The remainder of the paper is organized as follows. In section 2, we present results 
for the EW synchronization problem on weighted uncorrelated SF networks from a 
constrained optimization viewpoint. In section 3, we discuss the related questions for 
idealized transport problems: weighted resistor networks and weighted random walks. 
A brief summary is given in section 4. 



2. Optimization of Synchronization in Weighted Complex Networks in 
Noisy Environments 

The EW process on a network is given by the Langevin equation 

N 

d t h t = ~Y, CijQii - hj) + Vl (t) , (1) 
i=i 

where hi(t) is the general stochastic field variable on a node (such as fluctuations 
in the task-completion landscape in certain distributed parallel schemes on computer 
networks ^JJ ESI El) and is a delta-correlated noise with zero mean and variance 
(rji(t)rij(t l ))=2Sij5(t — t'). Here, dj=Cji>0 is the symmetric coupling strength 
between the nodes i and j (Cu=0). Defining the network Laplacian, 

= SijCi — Cij , (2) 

where Cj = Yli^ih we can rewrite Eq. 

N 

d t hi = Tijhj + r/i(t) . (3) 
i=i 

For the steady-state equal-time two-point correlation function one finds 

N-l 

G i:i = {{hi - h){hj - h)) = r^. 1 = J2 -r-Mkj , (4) 

7 1 ^ 

k—1 
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where h = (1/N) X).-_ i hj and (...) denotes an ensemble average over the noise in 
Eq. J3J). Here, denotes the inverse of F in the space orthogonal to the zero mode. 
Also, {4>ki}iLi aim ^fe) k — 0, 1, . . . , N — 1, denote the fcth normalized eigenvectors 
and the corresponding eigenvalues, respectively. The k = index is reserved for the 
zero mode of the Laplacian on the network: all components of this eigenvector are 
identical and Ao = 0. The last form in Eq. @ (the spectral decomposition of T -1 ) 
can be used to directly employ the results of exact numerical diagonalization. The 
average steady-state spread or width in the synchronization landscape can be written 

as ESI ESI E3 

I N \ N N-l 

\ i=\ I i=l k=l 

The above observable is typically self-averaging (confirmed by numerics), i.e., the 
width (w 2 ) for a sufficiently large, single network realization approaches the width 
averaged over the network ensemble. 

The focus of this section is to optimize synchronization (i.e., minimize the width) 
on (?) weighted uncorrelated networks with SF degree distribution, (ii) subject to fixed 
a cost. In the context of this work, we define the total cost Ctot simply to equal to 
the sum of weights over all edges in the network 

^ Cij — 2 ^ij = Ctot • (6) 

i<j i,j 

The elements of the coupling matrix CV,- can be expressed in terms of the network's 
adjacency matrix Aij and the assigned weights Wij connecting node i and j as 
dj = Wij A^. Here, we consider networks where the weights are symmetric and 
proportional to a power of the degrees of the two nodes connected by the link, 
Wij oc (kikj)P . We choose our cost constraint to be such that it is equal to that 
of the unweighted network, where each link is of unit strength. 

Cij = 2C t ot = A v = N * » ( ? ) 

where k — J2i h/N — J2i j Aij/N is the mean degree of the graph, i.e., the average 
cost per edge is fixed. Thus, the question we ask, is how to allocate the strength of 
the links in networks with heterogeneous degree distributions with fixed total cost in 
order to optimize synchronization. That is, the task is to determine the value of (3 
which minimizes the width Eq. ©, subject to the constraint Eq. 0. 

Combining the form of the weights, Wij oc (kikj)^ , and the constraint Eq. 
one can immediately write for the coupling strength between nodes i and j 



jT Aij (kik--^ 

S/.n Al n (kik n ) 



C<i = Nk ^ v \>> SH (8) 



From the above it is clear that the distribution of the weights is controlled by a single 
parameter (3, while the total cost is fixed, Ctot — Nk/2. 



2.1. The globally optimal network with fixed cost 

Before tackling the above optimization problem for the restricted set of heterogeneous 
networks and the specific form of weights, one may ask what is the optimum among 
all networks with fixed cost, for which the EW synchronization problem yields the 
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minimum width. This will serve as a "baseline" reference for our problem. From the 
above framework it follows that 

2c tot = c « = E = H r « = Tr ( r ) = E Xi ■ ( 9 ) 

Thus, the global optimization problem can be cast as 

1 1 

(w 2 ) = — > — = minimum , (10) 
AT ^— ' A; v ' 

f=i 

with the constraint 
N-i 

A, = 2C tot = fixed . (11) 
l=i 

This elementary extremum problem, Eqs. I jlOjl and JUJ, immediately yields a solution 
where all N— 1 non-zero eigenvalues are equal, 

Ai= A^T' ^ 1 '2,--- ! ^-l, (12) 
and the corresponding absolute minimum of the width is 

(13) 

As one can easily see, the above set of identical eigenvalues corresponds to a coupling 
matrix and network structure where each node is connected to all others with identical 
strength Cy = 2Ctot/[N(N — 1)]. That is, for fixed cost, the fully connected (FC) 
network is optimal, yielding the absolute minimum width. 

If we now consider the synchronization problem on any network with AT nodes, 
with average degree k, with total cost Ctot = Nk/2 to be optimized with respect to 
the single parameter (3, the above result provides an absolute lower bound for the 
optimal width 

, 9, „ (N- 1) 2 1 1 

While the above results for the FC network provide a mathematical absolute 
upper bound for the synchronization efficiency (absolute lower bound for the width), 
one may wonder about the technological feasibility of FC networks from a system- 
design viewpoint. While, clearly, the performance of the FC network in noisy 
synchronization is theoretically optimal among all networks of the same cost, in many 
realistic scenarios, it is not realizable in the large-A^ limit: For fixed total cost of 
Ctot ~ O(N) the link strength is of 0(1/N). In "hard-wired" infrastructure networks, 
there is a minimal cost per link, i.e., one cannot construct links for an arbitrary low 
infinitesimal [0(1/N)] cost. Thus, in actual applications it may not be possible to 
trade sparse networks with 0(1) average degree with links of strength 0(1) for fully- 
connected ones with the same cost with an average degree O(N) with links of strength 
0(1/N). 

In abstract ( "logical" ) communication networks, where in principal, each node can 
communicate with all others (but the actual messages are routed through a "physical" 
sparse hard-wired network) a FC logical communication network can be realized in 
a dynamic (or "annealed" ) fashion [37] . At each time step, each node communicates 
with another one chosen at random with a given frequency. 
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2.2. Mean-field approximation on uncorrelated SF networks 

First, we approximate the equations of motion [Eq. p}] by replacing the local weighted 
average field (1/Cj) J2j Cijhj with the global average h (the mean-height) 

N / c h\ 

d t hi = -J2 Cij(hi - hj) + m(t) = -Q (hi - ^ 3 c l ° - j + %(i) 

w-Ci(/n-&)+»ji(t) . (15) 

As can be directly seen by summing up Eq. Q over all nodes, the mean height h 
performs a simple random walk with noise intensity 0(1/N). Thus, in the mean-field 
(MF) approximation, in the asymptotic large- N limit, fluctuations about the mean are 
decoupled and reach a stationary distribution with variance 

((h-h) 2 ) w 1/d , (16) 

yielding 

<- 2 > = ^f>*-M 2 >^E^- (it) 

i—l i 

Next, we establish an approximate relationship between the effective coupling to 
the mean, Cj, and the degree fe« of node i, for uncorrelated (UC) weighted random 
graphs. Using the specific form of the weights as constructed in Eq. (JSJ, we write 

Ci = Y Cij = Nk ^Yn^l = iVfc k l^i^L . (is) 

For large minimum (and in turn, average) degree, expressions of the form Ej Aijkj 
can be approximated as 



^ k 




J2jAijk^ ^jAijk 13 



12 , - J2 3 A t j 

dkP{k\h)k p , (19) 



where P(k\k') is the probability that an edge from node with degree k' connects to 
a node with degree k. For uncorrelated random graphs, P(k\k') does not depend on 
k', one has P(k\k') = kP(k)/(k) \n\]§7\, where P(k) is the degree distribution and 
(k) is the ensemble-averaged degree. Thus, Eq. (I18f) . for UC random networks, can be 
approximated as 

r ~ N(k) fc f +1 / dkP{k\h)kP 

l ~ N J dk'k'l 3+1 P(k') j dkP(k\k')kP 

z,/3+i 

= (fc) £°dfc'fcVip(fcO • (20) 

Here, we consider SF degree distributions, 

P(k) = (7 - l)m~<- l k-~< , (21) 

where m is the minimum degree in the network and 2 < 7 < 3. The average and 
the minimum degree are related through (fc) = 771(7 — l)/(7 — 2). No upper cutoff is 
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needed for the convergence of the integral in Eq. lj2U|) . provided that 2 + [3 — 7 < 0, 
and one finds 

Thus, for uncorrelated random SF graphs with large minimum degree, the effective 
coupling coefficient d only depends on the degree k% of node i, i.e., for a node with 
degree k 

Finally, assuming self-averaging for large enough networks and combining the above, 
one obtains for the width of the synchronization landscape 

1 1 f°° 1 



1 1 r x 

= J_ fcll! (24) 

where using infinity as the upper limit is justified for 7 + P > 0. Elementary analysis 
yields the main features of the above expression for the average width: 

(i) (w 2 {P)) is minimum at P = P* = — 1, independent of the value of 7. 

(ii) ( W 2 ) mi „ = (^ 2 (/3*)} - l/(k) 

The above approximate result is consistent with using infinity as the upper limit in all 
integrals, in that the optimal value P* — — 1 falls inside the interval —7 < P < 7 — 2 
for 2 < 7 < 3. Interestingly, one can also observe, that, in this approximation, the 
minimal value of the width is equal to that of the global optimum [Eq. I|14[l] , realized 
by the fully connected network of the same cost N(k)/2, i.e. with identical links of 
strength (k)/(N - 1). 

We emphasize that in obtaining the above result [Eq. i|24|) ] we employed two 
very strong and distinct assumptions/approximations: (i) for the dynamics on the 
network, we neglected correlations (in a MF fashion) between the local field variables 
and approximated the local height fluctuations by Eq. (|16f) : (ii) we assumed that the 
network has no degree-degree correlations between nodes which are connected (UC), 
so that the "weighted degree" Ct can be approximated with Eq. (|22|l for networks 
with to3>1. 



2.3. Numerical results 

For comparison with the above mean-field results, we considered Barabasi- Albert (BA) 
SF networks t, "grown" to N nodes, where P{k) = 2m 2 /k 3 , i.e., 7 = 3. While 

growing networks, in general, are not uncorrelated, degree-degree correlations are 
anomalously (marginally) weak for the B A network |IT7| |S5] . 

We have performed exact numerical diagonalization and employed Eq. J1J to find 
the local height fluctuations and Eq. JSJ to obtain the width for a given network 
realization. We carried out the above procedure for 10-100 independent network 

I For the BA scale- free model 1151 (growth and preferential attachment), each new node is connected 
to the network with m links, resulting in (k) ~ 2m in the large-TV limit. Here, we employed a 
fully-connected initial cluster of m + 1 nodes. 
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Figure 1. Height fluctuations as a function of the degree of the nodes for ^=1000, 
(k) = 20, and for (a) /3=-2.00, (b) /3=-1.50, (c) /3=-1.00, and (d) (3=0.00. Data, 
represented by filled symbols, are averaged over all nodes with degree k. Scatter 
plot (dots) for individual nodes is also shown from ten network realizations. Solid 
lines correspond to the MF+UC scaling ((Ah) 2 ) k ~ k~ ( -' 3 + 1 \ 



realizations. Finite-size effects (except for the m—1 BA tree network) are very weak 
for — 2 < j3 < 1; the width essentially becomes independent of the system size. Figure^ 
displays result for the local height fluctuations as a function of the degree of the node. 
We show both the fluctuations averaged over all nodes with degree k and the scattered 
data for individual nodes. One can observe that our approximate results for the scaling 
with the degree [combining Eqs. (HHJ and (22)], ((h { - h) 2 ) « 1/C, ~ k~ {0+1 \ work 
very well, except for very low degrees. The special case /3=0, is exceptionally good, 
since here Cj = ■ — k{ exactly, and the only approximation is Eq. (|16|l . 

In Fig. [2 we show our numerical results for the width and compare it with the 
approximate (MF+UC) results Eq. (|24|1 . They agree reasonably well for networks 
with m>l. The divergence of the approximate result Eq. Ij24(l at j3= —3 and (3= 1 
is the artifact of using infinity as the upper limit in the integrals performed in our 
approximations . 

The results for the width clearly indicate the existence of a minimum at a value 
of (3* somewhat greater than —1. As the minimum degree m is increased, the optimal 
f3 approaches —1 from above. This is not surprising, since in the limit ofm> 1 (large 
minimum degree) , both the MF and the UC part of our approximations are expected 
to work progressively better. In Fig. |3 we show the width as a function of l/m for 
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Figure 2. (a) Steady-state width of the EW synchronization landscape as a 
function of the weighting parameter j3 for the BA networks for ./V=1,000 with 
various average degree k ~ (k) ~ 2m. Solid curves are the scaled approximate 
(MF+UC) results [Eq. 1241 1 for the same degree. For comparison, numerical 
results for SW networks with the same degree (with the respective open symbols) 
are also shown. Also, see Table^for actual numerical values for f3=—l. (b) Scaled 
width as a function of the weighting parameter j3. The solid curve is the scaled 
approximate (MF+UC) result [Eq. 1241 1. The horizontal dashed line indicates 
the (similarly scaled) absolute lower bound, as achieved by the fully connected 
network with the same cost N(k)/2. 



the BA networks, indicating the rate of convergence to the MF+UC result, Eq. I|24(l . 
Fig. |3 also indicates that finite-size effects are very small and only contribute as small 
corrections to the finite value of the width in the linmit of N-^oo. For /3=0, our 
approximation [Eq. ({2"4"|l ] is within 8%, 4%, and 1% of the numerical results (based on 
the above exact numerical diagonalization procedure) for m—10, m=20, and m=100, 
respectively. For j3=—l, it is within 15%, 7%, and 3% of the numerical results for 
m=10, to=20, and to=100, respectively. Thus, our approximation works very well 
for large uncorrelated sparse SF networks with sufficiently large, finite minimum (and 
consequently, average) degree. 

The above optimal link-strength allocation at around the value /?*=— 1 seems to 
be present in all random networks where the degree distribution is different from a 
delta-function. For example, in SW networks, although the degree distribution has 
an exponential tail, (w 2 ) also exhibits a minimum, but the effect is much weaker, 
as shown in Fig. |2Ia). Further, a point worthwhile to mention, a SW network with 
the same number of nodes and the same average degree (corresponding to the same 
cost) always "outperforms" its SF counterpart (in terms of minimizing the width). 
The difference between their performance is smallest around the optimal value, where 
both are very close to that of the lowest possible value, realized by the FC network of 
the same cost (Tabled) 
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Figure 3. Steady-state width of the EW synchronization landscape as a function 
of 1/m for the BA networks for j3 = 0.00 (solid symbols) and j3 = —1.00 (respective 
open symbols), for three different system sizes. Straight lines (solid for /3=0 and 
dashed for j3=—l) correspond to the MF+UC approximation Eq. 1241 . 



Table 1. Comparing numerical values of the steady-state width (w 2 ) of the 
EW process at fi=— 1 for BA and SW networks of the same finite average degree 
(k) and cost N(k)/2 (for 7V=1000) with results of the MF+UC approximation 
Eq. 1241 . Note that the width in the MF+UC approximation for j3=— 1 coincides 
with that of the globally optimal FC network of the same cost [compare Eqs. 1141 
and 1241 1. {w 2 ) ~ l/(k). Error bars on the numerically obtained values for the 
BA and SW networks are less that the last digit shown in the table. 
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20 


0.0571 


0.0531 


0.0500 


200 


0.0053 
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3. Connections with Transport and Flow Problems in Weighted Networks 

3.1. Optimizing the system resistance in weighted resistor networks 

Resistor networks have been widely studied since the 70 's as models for conductivity 
problems and classical transport in disordered media |K91 I70| . Amidst the emerging 
research on complex networks, resistor networks have been employed to study and 
explore community structures in social networks |711 1721 173| . Most recently, they 
were utilized to study transport efficiency in SF and SW networks [33] . The 

work by Lopez et al. revealed that in SF networks ^3 E| anomalous transport 
properties can emerge, displayed by the power-law tail of distribution of the network 
conductance. Now, we consider weighted resistor networks subject to a fixed total 
cost (the cost of each link is associated with its conductance) . 

In a recent paper we have shown that observables in the EW synchronization 
problem and in (Ohmic) resistor networks are inherently related through the spectrum 
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of the network Laplacian |35j . Consider an arbitrary (connected) network where is 
the conductance of the link between node i and j, with a current I entering (leaving) 
the network at node s (t). Introducing the voltages measured from the mean at each 
node, Vi = Vi- V, where V=(l/N) £f =1 V u one obtains [33] 

Vi = I(G ls -G it ). (25) 

Here, G is the same network propagator discussed in the context of the EW process, 
i.e. the inverse [Eq. (0}] of the network Laplacian [Eq. in the space orthogonal to 
the zero mode. Applying Eq. (|25|l to nodes s and i, where the voltage drop between 
these nodes is V st = V s — Vt, one immediately obtains the effective two-point resistance 
of the network between nodes s and t |35] \7Q , 

V N ^ 1 

R st = -f = G ss + G tt - 2G st = + ^ ~ 2 Mkt) • (26) 

fc=i k 

The spectral decomposition in Eq. (|26|) is, again, useful to employ the results of exact 
numerical diagonalization. Comparing Eqs. J3J and l|26[> . one can see that the two- 
point resistance of a network between node s and t is the same as the steady-state 
height- difference correlation function of the EW process on the network |85| . 

((h s -h t ) 2 ) = {[{h s -h) - {h t -h)] 2 ) =G a3 +Gtt-2G st = i? st .(27) 
For example, using the above relationship and the employing the MF+UC 
approximation §, one can immediately obtain the scaling of the typical value of the 
effective two-point resistance in weighted resistance networks, between two nodes with 
degrees k s and k t , 

R st ~ G ss + G tt ~ + ^-(i+Wj = fc ^+^7 . (28) 

A global observable, measuring transport efficiency, analogous to the width of the 
synchronization landscape, is the average two-point resistance |35l Ifi2| (averaged over 
all pairs of nodes, for a given network realization). Using Eq. H27J) and exploiting the 
basic properties of the Green's function, one finds 

R = N(N — 1) |5 ^ = N(N — 1) ^ Rst 

A 2(w 2 ) ~ 2(w 2 ) , (29) 



N - 1 

i.e., in the asymptotic large system-size limit the average system resistance of a given 
network is twice the steady-state width of the EW process on the same network. Note 
that the above relationships, Eqs. (|27J) and (|29(l . are exact and valid for any graph. 

The corresponding optimization problem for resistor networks then reads as 
follows: For a fixed total cost, Ctot = Sj<j Qj — where the link conductances 

are weighted according to Eq. JSJ), what is the value of [3 which minimizes the 
average system resistance R(0)1 Based on the above relationship between the average 
system resistance and the steady-state width of the EW process on the same graph 
[Eq. I)29|l ]. the answer is the same as was discussed in section 2 [Eq. I|24|l ] : /?*=— 1 
and i? m i n = 2N/[(N— l)(fc)] — 2/(k) in the mean-field approximation on uncorrelated 
random SF networks. Numerical results for R(f3) are also provided for "free" by virtue 
of the connection Eq. Ij29(l . once we have the results for (w 2 (/3)). 

§ In the context of resistor networks, while there are no "fields" , we carry over the terminology "mean- 
field" (MF) from the associated EW synhronization problem. In terms of the network propagator, the 
assumptions of the MF approximation can be summarized as G s t<SCG ss for all sj^t, and G BS ~1/C S . 
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3.2. Connection with random walks on weighted networks and congestion- aware local 
routing schemes 

Consider the weights {CVj} employed in the previous sections and define a random 
walk (RW) with the transition probabilities [M] 

Pij = |f (30) 

and recall that Cj = J^i Gu ■ Pij is the probability that the walker currently at node 
i will hop to node j in the next step. Note that because of the construction of the 
transition probabilities (being a ratio), the issue of cost constraint disappears from the 
problem. That is, any normalization prefactor associated with the conserved cost [as 
in Eq. JHJ] cancels out, and the only relevant information is CV,- oc Aij(kikj)@ , yielding 



Conversely, the results are invariant for any normalization/constraint, so for 
convenience, one can use the normalized form of the CV, coefficients as given in Eq. (jHJ. 

Having a random walker starting at an arbitrary source node s, tasked to arrive 
at an arbitrary target node t, the above weighted RW model can be associated 
with a simple local routing or search scheme |55) where packets are independently 
forwarded to a nearest neighbor, chosen according to the transition probabilities 
Eq. (PU, until the target is reached. These probabilities contain only limited local 
information, namely the degree of all neighboring nodes. By construction, the 
associated local (stochastic) routing problem (section 3.2.3) does not concern link 
strength (bandwidth) limitations but rather the processing/queuing capabilities of the 
nodes, so the cost constraint, associated with the links, disappears form the problem. 

3.2.1. Node betweenness for weighted RWs In network-based transport or flow 
problems, the appropriate betweenness measure is defined to capture the amount 
of traffic or information passing through a node or a link, i.e., the load of a node or 
a link [TZl 113 E31 EH E3 ESI ESI ESI Here, our observable of interest is the node 
betweenness Bi for a given routing scheme [HS] (here, purely local and characterized 
by a single parameter (3): the expected number of visits to node i for a random walker 
originating at node s (the source) before reaching node t (the target) £7?' , summed 
over all source-target pairs. For a general RW, as was shown by Doyle and Snell |B3|. 
E^' can be obtained using the framework of the equivalent resistor-network problem 
(discussed in section 3.1). More specifically, 

Ef = d{Vi -V t ), (32) 

while a unit current is injected (removed) at the source (target) node. Utilizing again 
the network propagator and Eq. (|25Jl . one obtains 

E s / = Ci(Vi - V t ) = QfYi - V t ) = CiC. - G it - G ts + G tt ) ■ (33) 

For the node betweenness, one then obtains 

s^t S^t s^t 

= y£^t = y^-l)#- (34) 
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Note that the above expression is valid for any graph and for an arbitrary weighted 
RW defined by the transition probabilities Eq. i|3UI) . As can be seen from Eq. I|34|) . 
the node betweenness is proportional to the product of a local topological measure, 
the weighted degree Ci, and a global flow measure, the average system resistance R. 
As a specific case, for the unweighted RW (/3=0) C; = Y^i^a — h, thus, the node 
betweenness is exactly proportional to the degree of the node, Bi = kiN(N — l)R/2. 

Using our earlier approximations and results for uncorrelated SF graphs Eq. (|22|l 
and l)24[l. and the relationship between the width and the average system resistance 
Eq. (|29|) . for weighted RW, controlled by the exponent /3, we find 

B0) = y N ( N - !) S = ^"V) 

« AT2 2_4^ . (35) 

First, we consider the average "load" of the network 

B = ^J2 B ^^f 1 ( N - 1 ^- ( 36 ) 

i 

Similar to Eq. 1|34|1 , the above expression establishes an exact relationship between the 
average node betweenness of an arbitrary RW [given by Eq. 1 (50) 1] and the observables of 
the associated resistor network, the total edge cost and the average system resistance. 
For example, for the [3=0 case, B = kN(N — l)R/2. As noted earlier, for calculation 
purposes one is free to consider the set of Cy coefficients given by Eq. J5J), which also 
leads us to the following statement: 

For a RW defined by the transition probabilities Eq. the average RW betweenness 

is minimal when the average system resistance of the associated resistor network with 
fixed total edge cost (and the width of the associated noisy synchronization network) 
is minimal. 

Utilizing again our earlier approximations and results for uncorrelated SF graphs 
and the relationship between the width and the average system resistance, we find 



B((3) = ^^(N-1)R = (j2c)j N(w 2 ) 



« N 2 ^ — ^- (37) 

( 7 -2-/J)( 7 + /3) [6 '> 

The average node betweenness is minimal for (5 = (3* — — 1, for all 7. 

3.2.2. Commute times and hitting times for weighted RWs The hitting time r st is the 
expected number of steps for the random walker originating at node s to reach node 
t for the first time. The commute time is the expected number of steps for a "round 
trip" between nodes s and t, r st + r ts . Relationships between the commute time and 
the effective two-point resistance have been explored and discussed in detail in several 
works [OSJ [771 [75] . In its most general form, applicable to weighted networks, it was 
shown by Chandra et al. [77] that 



ru=[}C i } R st . (38) 
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For the average hitting (or first passage) time, averaged over all pairs of nodes, one 
then obtains 

T S N(N-l) Ts ' 1 = 2N(N-1) ^J (Ts '* + Tt ' s) 

Comparing Eq. and l|39|l . the average hitting time (the average travel time for 
packets to reach their destinations) then can be written as f = B/(N — 1). Note that 
this relationship is just a specific realization of Little's law |79l 180) . in the context of 
general communication networks, stating that the average time needed for a packet 
to reach its destination is proportional to the total load of the network. Thus, the 
average hitting time and the average node betweenness (only diffcrring by a factor 
of iV-1) are minimized simultaneously for the same graph (as a function of /3, in our 
specific problem). 

3.2.3. Network congestion due to queuing limitations Consider the simplest local 
"routing" problem O EH] m which packets are generated at identical rate (f> at each 
node. Targets for each newly generated packet are chosen at uniformly random 
from the remaining N — 1 nodes. Packets perform independent, weighted RWs, 
using the transition probabilities Eq. (|30|) . until they reach their targets. Further, 
the queuing/processing capabilities of the nodes are limited and are identical, e.g. 
(without loss of generality) each node can send out one packet per unit time. From 
the above it follows that the network is congestion-free as long as 

tj^i < 1 - (40) 

for every node i OEHETJEHEII] As the packet creation rate <j> (network throughput 
per node) is increased, congestion emerges at a critical value </> c when the inequality 
in Eq. (|40)l is first violated. Up to that point, the simple model of independent 
random walkers (discussed in the previous subsections) , can self-consistently describe 
the average load landscape in the network. Clearly, network throughput is limited by 
the most congested node (the one with the maximum betweenness), thus 

N — 1 

0c = -5 , (41) 

a standard measure to characterize the efficiency of communication networks [541 1551 

|571 EH mi . 

To enhance or optimize network throughput (limited by the onset of congestion 
at the nodes), one may scale up the processing capabilities of the nodes |57| . optimize 
the underlying network topology |55| . or optimize routing by finding pathways which 
minimize congestion ESJEniEOl- The above RW routing, controlled by the weighting- 
parameter /3, is an example for the latter, where the task is to maximize global network 
throughput by localy directing traffic. In general, congestion can also be strongly 
influenced by "bandwith" limitations (or collisions of packets), which are related to 
the edge betweenness, and not considered here. 

For (3>— 1, within our approximations, nodes with high betweenness coincide with 
nodes with high degree. Further, for nodes with high degree, the mean-field approach 
on uncorrelated SF graphs is expected to work reasonably well. In this region, the 
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scaling behavior B max is related to that of the highest degree k max in the graph of 
finite size N. The scaling of the maximum degree with the system size, however, 
even for idealized SF network models, is very sensitive to the details of the network 
construction. For example, in the region of our interest, 2 < 7 < 3, for the standard 
configuration model (CM) [SI], the largest degree is governed by the natural cutoff, 
fc max ~ miV 1 ^ 7-1 - 1 ^| |H2], but this network has correlations, especially between 
nodes with larger degrees [HE1 E2j ■ So one may use the MF+UC approximation, but 
should expect stronger corrections. On the other hand, in a recent construction for SF 
networks, the uncorrelated configurational model (UCM) the resulting network 
is genuinely uncorrelated, and the largest degree is governed by the structural cutoff, 
fc max ~ ((fc)iV) 1/2 EH E3 EH EH Combining these cutoff behaviors with Eq. 
for the CM scale-free network model with the natural cutoff one has 



7 + p m J+p 7 + p 



and 

N — l 7 + /3 lxr _z±£ „ , ^ ,., T+/ ? ' 
7 ' 

Similarly, for the UCM scale-free network model one finds 



- ^ - l±fv"£f ~ O (N-&) . (43) 

Dmav T — 1 V / 



1 + /3 



«f (/?) ^ , (44) 

7 + P V 7 — 2 to ' 



and 

^^Ht^J -O^j. (45) 

From the above expression one can see that in the f3> — l region, for large N, the 
exponential decay in (3 dominates for both the CM [Eq. gjJJ] and UCM [Eq. igSJ] 
scale- free networks. Consequently, in the semi-infinite region /3>— 1, 4> c {f3) is a 
monotonically decreasing function of p\ 

For /3< — 1, nodes with high betweenness are the nodes with a low degree, but 
for these nodes the above approximations are expected to work poorly. Further, 
there are many nodes with a degree of order m, and the actual distribution of the 
betweenness [through the weighted degrees Q, Eq. pijl] for nodes with with fc,~m, 
depends strongly on the "local" fluctuations of the network disorder (randomness of 
the network structure). Ignoring all of the above, and blindly using Eq. I|35(l with 
k m i n =m, one finds 4> c {f3) ~ -^-z^N^ 1 , which is a monotonically increasing function of 
(3 in the semi- infinite region [3< — 1. Thus, within our crude approximate scheme, the 
throughput is maximum at f3*——l. 

Numerical work, performed on the BA network (7=3), supports the above simple 
analysis. The BA network is somewhat special, in that correlations are anomalously 
weak (or marginal), and the structural and natural cutoffs exhibit the same 0(N 1 / 2 ) 
scaling with the system size. Testing our MF+UC predictions, we find that the 
betweenness is, indeed, strongly correlated with the degree, in line with Eq. (|3~5|l 
[Fig. 21 Further, for [3 > /?*«— 1, the tail of the degree distribution governs 
the tail of the distribution of the betweenness. Specifically, the cumulative degree 
distribution, P>(k) ~ fc 1-7 translates to the cumulative betweenness distribution 
P y {B) ~ J g( 1 -7)/(i+/3) [Fig. [5]. For (3 < [3*^-1, as noted above, the large-B tail 
of the betweenness distribution is coming from the small-fc behavior of the degree 
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Figure 4. Normalized RW node betweenness on BA networks with m=3 as 
a function of the degree of the nodes for four system sizes [N= 200 (dotted), 
400 (dashed), 1000 (long-dashed), 2000 (solid)] for (a) /3=-2.00, (b) /3=-1.00, 
(c) /3=0.00, and (d) /3=1.00. Data point represented by lines are averaged 
over all nodes with degree k. Data for different system sizes are essentially 
indistinguishable. Scatter plot (dots) for the individual nodes is also shown from 
ten network realizations for Af=1000. Solid curves, corresponding to the MF+UC 
scaling B(k) ~ k fl+1 [Eq. 1551 1. are also shown. 

distribution. While there is a strict lower cutoff in the degrees to, there are many 
nodes with degree to. It is then the quenched randomness in the particular network 
realization which ultimately governs the upper cutoff of the betweenness (through 
the weighted degrees Cj). The tail of the betweenness distribution is essentially 
independent of AT and numerically found to scale in an exponential-like fashion [Fig.[5]. 

As qualitatively predicted by the MF+UC approximation, the critical network 
throughput 4> c {f3) exhibits a maximum at around /3*~— 1, corresponding to the optimal 
weighting scheme, as shown in Figs.El Further, in the 0>— 1 region, where the long tail 
of the degree distribution dominates the network behavior, the network throughput 
scales with the number of nodes as ~ JSf-h+^/if- 1 ) _ [Note that for the BA network 
(7=3), the scaling with A~ by Eqs. 143J1 and 1)45(1 coincide.] The results for the scaled 
throughput are shown in Figs. [7| 

In a recent, more realistic network traffic simulation study of a congestion-aware 
routing scheme, Danila et al. |59| found qualitatively very similar behavior to what we 
have observed here. In their network traffic simulation model, packets are forwarded 
to a neighbor with a probability proportional to a power (3 of the instantaneous queue 
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Figure 5. Cumulative distribution of the normalized RW node betweenness for 
BA networks with m=3 for four system sizes [N= 200 (dotted), 400 (dashed), 
1000 (long-dashed), 2000 (solid curves)], and for various values of /3 indicated in 
the figure. Straight dashed lines correspond to the predicted power-law tail of the 
cumulative distribution for /3>-l, P > (B) ~ b(1-7)/CH-P). 

length of the neighbor. They found that there is an optimal value of the exponent /3, 
close to —1. 

We also show numerical results for network throughput for SW networks with 
the same degree [Fig. HJa)]. In particular, an optimally weighted SW network always 
outperforms its BA scale-free counterpart with the same degree. Qualitatively similar 
results have been obtained in actual traffic simulation for networks with exponential 
degree distribution 

To summarize, the above simple weighted RW model for local routing on SF 
networks indicates that the routing scheme is optimal around the value /3*~— 1. At 
this point, the load is balanced [Eq. and Fig.^Jb)], both the average load and the 
average packet delivery time are minimum, and the network throughput is maximum 
[Fig. El- 

From a viewpoint of network vulnerability [SSI [HS1 IH^l [HH1 [HS] j the above results 
for the weighted RW routing scheme also implies the following. Network failures 
are often triggered by large load fluctuations at a specific node, then subsequently 
cascading through the system [HE]- Consider a "normal" operating scenario (i.e., 
failure is not due to intentional/targeted attacks), where one gradually increases the 
packet creation rate (j) an d the overloaded nodes (ones with the highest betweenness) 
gradually removed from the network For f3 > 1 (including the unweighted 

RW with (3=0), these nodes are the ones with the highest degrees, but uncorrelated 
SF networks are structurally vulnerable to removing the hubs. At the optimal value 
of /3, not only the network throughput is maximal, and the average packet delivery 
time is minimal, but the load is balanced: overloads are essentially equally likely to 
occur at any node and the underlying SF structure is rather resilient to random node 
removal |851 186| . Thus, at the optimal value of f3, the local weighted RW routing 
simultaneously optimizes network performance and makes the network less vulnerable 
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Figure 6. Critical network throughput per node as a function of the weighting 
parameter j3 for BA networks (solid symbols) for various system size for (a) m=3 
and for (b) m=10. Figure (a) also shows the same observable for SW networks 
(the same respective open symbols) for the same system sizes. 
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Figure 7. Scaled critical network throughput per node on BA networks as a 
function of the weighting parameter j3 in the /3> — 1 region for (a) m=3 and (b) 
m=10. 



against inherent system failures due to congestions at the processing nodes. 
4. Summary 

We studied the EW process, a prototypical synchronization problem in noisy 
environments, on weighted uncorrelated scale-free networks. We considered a specific 
form of the weights, where the strength (and the associated cost) of a link is 
proportional to (kikj)P with fcj and kj being the degrees of the nodes connected by 
the link. Subject to the constraint that the total network cost is fixed, we found that 
in the mean-field approximation on uncorrelated scale-free graphs, synchronization 
is optimal at /3*=— 1. Numerical results, based on exact numerical diagonalization 
of the corresponding network Laplacian on BA SF networks, confirmed the mean- 
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field results, with small corrections to the optimal value of (3*. Although here, 
because of the presence of noise and the cost constraint, the setup of the problem 
is quite different, our results are very similar to that of the synchronization of coupled 
nonlinear oscillators by Zhou et al. |28|. 

Employing our recent connections |35| between the EW process and resistor 
networks, and some well-known connections between random walks and resistor 
networks [12] HUB EH HEj> we also explored a naturally related problem of 
weighted random walks. For the simple toy problem, we found that using the 
associated RW transition probabilities proportional to a power (3 of the degree of the 
neighbors [Eq. I|31[) ]. the local "routing" is optimal when the j3*=— 1 (in the mean- 
field approximation). At this optimal network operation point, the load is balanced, 
both the average load and the average packet delivery time are minimum, and the 
network throughput is maximum. Since the load is balanced, and thus, can lead to 
local overloads and subsequent failures at any nodes with roughly equal probabilities, 
the above optimal operating point is also the most resilient one for the underlying 
scale-free communication network. While the above local weighted "routing" is overly 
simplified, some aspects of it can be possibly combined with existing realistic protocols 
to optimize performance in queue-limited communication networks. For example, 
existing protocols often utilize an appropriately defined metric for each node, capturing 
their "distance" (the number of hops) to the current target ^01 HQ ■ A node then 
forwards the packet to a neighbor, which is closer to the target than itself. There 
may be many nodes satisfying this criterion, so the forwarding node could employ the 
weighting RW scheme [Eq. IpHjl]. applied to this subset, to select the next node. This 
may result in improved delivery times and in the delaying of the onset of congestion. 
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